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PREFACE 

This report identifies the character I sties of logistics system 
capability assessment and s lockage optimisation methods that reflect the 
unique nature of the National Aeronautics and Space Administration's 
Space Transportation System's ( STS ) launch flnd recovery cycle. It 
presents the mathematical foundations of approaches to such methods and 
demonstrates their feasibility in the context of NASA's and the U.S, Air 
Force's need to develop a sound, well-formulated logistics -tupport 
strategy for the STS program, 

This is a final report on a research project, sponsored by NASA, 
the main purpose of which is to develop initial logistics methodologies 
relevant to NASA's STS. The report contains an extensive., non-tec, hincal 
summary that should be of interest to NASA and Air Force, personnel 
involved in logistics support of the STS urogram should also be of 

interest to those concerned with technical aspects of logistics support 
and with mothematical derivations of the recommended methods, 
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SUMMARY 


NASA and the (J.S. Ait Force currently face policy decisions of 
fundamental importance to the formulation of a sound, coherent, 
logistics support strategy for the Space Transportation System (STS), 

The importance of these decisions is clear. They not only involve largo 
amounts of money, but they alco will shape the essential character, 
quality, and cost*ef fectivenoss of STS logistics support. 

The policy decisions to be made include determination of the 
maintenance concept for the STS, i.e. , the location, depth, and scope of 
component repair, levels of maintenance, and repair responsibility; the 
modes of transportation to be used for retrograde and serviceable 
component shipments; the proportion Ci component repairs to be done at 
each level of maintenance; the amount of investment in tools and 
equipment and its allocation; the amount of investment in reparable and 
consumable spare parts; and the spares stock level, by location, of each 
of the system's components. 

Clearly, these decisions are interrelated. The computation of a 
spares posture depends on component characteristics, such as repair 
times and transportation time,s, that are the products of other policy 
variables, such as maintenance concept and level-of-repair decisions, 
NASA needs to understand how alternative maintenance concepts, choices 
of repair locations, repair level decisions, and transportation modes 
affect, for example, spares investment requirements and launch 
capability as a function of those investments. The complexity and 
interdependencies of the decisions suggest the need for a logistics 
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system capability assessment methodology that would enable NASA to 
evaluate policy alternatives as they affect a direct and meaningful 
measure of system performance, such ns expected launch delay, and to do 
so in full light of the costs of those alternatives. Implicit in such a 
capability assessment methodology is the need for explicit 
representation of the relationship between system performance and spares 
investment level. 

To assist NASA in meeting these needs, this report identifies the 
characteristics of an analytical modeling capability that would relate 
logistics support decisions and resource requirements to the capability 
to meet STS launch schedules, taking into account the unique 
characteristics of the shuttle program with its small fleet size and 
tight recovery and launch schedule, The report also presents feasible 
analytic approaches to both the capability assessment and the spares 
optimization problems, Because such analytic capability is only as good 
as the input data, the report discusses the quality and availability of 
data within NASA. 

THE UNIQUE DIMENSIONS OF THE STS PROBLEM 

NASA's STS Program differs sharply from previous NASA programs, 
such as Apollo. STS is NASA's first program with a relatively high 
launch rate of reusable vehicles; as a result, NASA has been faced with 
developing logistics policies to support a program that represents a 
significant departure from those supported previously. The analytical 
methodologies and decision aids available to support logistics decisions 
were developed for sustained military operations. But the STS Program, 
unlike the military, has a very small fleet size and a tight, but well- 
defined, launch schedule, both of which impinge upon the development of 
sound logistics policies. 
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Most of the capability assessment and spares optimization methods 
that are readily available wore developed for military aircraft, whi-.li 
are usually deployed in large numbers and generate a relatively largo 
number of sorties. A typical performance measure used by these methods 
is the number of mission-ready or mission-capable aircraft. Because one 
cannot predict when these aircraft must be mission capable, "ready" is 
taken to mean "ready at a random point in time." 

Shuttle operations, by contrast, are characterized by a small fleet 
size (four or five) and a relatively low sortie rate of about 20 per 
year during full-scale operation. Thus, measures relating to launch 
delay rathe? than to the number "ready" are probably more relevant to 
shuttle operations. The problems of determining stockage requirements 
and logistics system capability using a measure of effectiveness 
directly related to launch delay have three distinguishing features: 

1. The shuttle vehicle is required to be ready not at all points 
in time, but within a given number of time units from the 
beginning of prelaunch shuttle recovery process. 

2. The prelaunch operations plan specifies a project network of 
activities to bo carried out. Given this plan, it should be 
possible to identify the points in the schedule where demands 
for a particular part might occur. 

3. The effect of a part shortage on launch delay depends not only 
on how long the shortage exists but also on (1) when in the 
schedule the demand occurs, (2) when the demand must be filled, 
and (3) the repair time of the part, which is a function of the 
basic repair level decision for the part in question. 
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The following example is presented to clarify the issues discussed 
above. It should not, of course, be construed as representing a typical 
shuttle prolaunch operation schedule. 

Figure S.l is a project network whose start is at node 1 and whose 
end is at node 7, The nodes represent events in time anu the arcs 
represent activities. The orientation of each arc is from the lower 
numbered node to the higher numbered node. The numbers on the atci 
represent activity times. For instance, activity (5,6) requires 5 time 
units and activity (3,4) requires 13 time units. The project network 
also reflects mandatory precedence relations, For instance, activity 
(3,4) may not begin until activity (2,3) is completed, and activity 
(6,7) may not begin until both activities (4,6) and (5,6) are completed. 
Note that the earliest possible completion time of this project is given 
by the length of the longer of the two paths beginning at node 1 and 
ending at node 7, The longest path in a project network is called the 
critical path and its length is the project duration. In the figure, 
the critical path follows the upper path and its total length is 44, 

Suppose that there are two line replaceable units, LRUj^ and LRU^, 
that can fail and possibly delay the project, Assume that LRU^ can fail 
at node 2 and that, if it does fail, it must be replaced before activity 
(5,6) can begin. We say that LRU^ has node 2 as its demand node and 
node 5 as its fill node. Suppose that LRl^ also has node 2 as its 
demand node, and has node 3 as its fill node. Finally, suppose that the 
repair time for LRUj is 16 and the repair time for LRUg is 5. Now, if 
there is no spare for either LRU, a failure of LRU^ will delay the start 
of activity (5,6) by 10 time units but will not delay the project. That 
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Fig. S.l — An illustrative network with two items subject to failure 

and associated resupply times - 
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is, the project duration is still 44 time units. However, if LRU 2 
fails, the project duration Will be increased by 3 time units to a total 
of 47, thus causing a delay, Under a typical ready-rate optimization, 
via marginal analysis, it is clear that there are conditions where 
spares of LRU^ will be stocked, but perhaps none of LRU^, even though 
LRU,, is the part most likoly to cause a delay, For instance, if the 
failure rate for LRU^ were larger than that for LRU^, and the cost of 
LRU^ less than the cost of LRU 2 , the stockage derived by marginal 
analysis would be greater for LRU, than for LRU^, Moreover, aside from 
condemnation spares, the stockage of both items would cost more than is 
needed to minimize delay. 

Additionally, if one is interested in deciding which repair times 
should be shortened, ready-rate or probability-of-sufficlency (PCS) 
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optimization methods, if used to determine the tradeoff between stockage 
costs and repair time reduction costs, will generally lead to incorrect 
results. For instance, under the assumptions above, such an analysis 
will conclude that there is greater payoff in reducing LRU^ repair time, 
than there, is in reducing LRU 2 repair time. Of course, the project 
network approach demonstrates that the exact opposite is true. 

It is clear then that models developed for military aircraft 
operations are probably not appropriate for the shuttle, and that 
logistics system capability -.ssossment and stockage optimization models 
for STS operations should have two important characteristics; Cl) 
measures of effectiveness should be related to launch delay, and (2) 
explicit considerations should be given to the prolaunch task network, 

CAPABILITY ASSESSMENT 

There are two general approaches to developing a logistics 
capability assessment model that best represents the STS environment: 
Monte Carlo simulation and analytic queueing modeling. Each approach 
has its advantages and disadvantages. Simulation is very little limited 
by the amounts of detail that car. be incorporated, but it usually 
requires a large, input data base and frequently becomes slow and costly 
to run. In addition, because, of random variations in any particular 
run, many computer runs are required to obtain a valid mean or standard 
deviation of any output measure. Therefore, especially for low-failure- 
rate-items, simulation may be unsuitable for use as a spare requirements 
methodology or for making sensitivity analyses. Indeed, the potentially 
threatening effects of low-failure-rate items on launch delay are 
usually difficult to expose through standard Monte Carlo simulation 
experiments . 
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Analytic queueing models are more ci^.ficult to derive and 
compromises usually have to be made about the amount of detail they can 
incorporate, But they definitely hove an advantage because of their 
ease of use, A single run can generate means and standard deviations, 
and dealing with many types of spare parts is not a problem, These 
typos of models, then, are often morn suitable for logistics system 
capability assessment, spares requirements computation, and sensitivity 
analyses , 

This report describes a new analytic queueing approach that relates 
stockago levels, repair level dacisions, and the project network 
schedule of prelaunch operations directly to the probability 
distribution of launch delay. As a result, this approach can produce 
several measures basil upon stock levels, repair, and transportation 
performance, These include expected delay and the probability of launch 
delay and its variance. Given appropriate inputs, it will also yield 
expected delay costs, as well as a rank-ordered list of those components 
most schedule-threatening. 

The approach was developed under a strict set of assumptions about 
the shape and character of the prelaunch task network, It is, however, 
appropriate for networks similar to the Air Force Test and Evaluation 
Center (AFTEC) network of shuttle recovery tasks, Although the 
theoretical feasibility of this approach has been demonstrated, the 
approach requires full evaluation with a detailed shuttle network that 
reflects the demand and fill nodes for each component, 
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SPARES STOCKAGE OPTIMIZATION 

The report describes two approaches to spares optimization under a 
budget constraint that have objective functions related to launch delay 
and that consider the prelaunch task network. The first is directly 
related to the approach used for capability assessment and is similarly 
restricted to networks such as thoso used by AFTEC, This approach is 
also relatively complicated and may require considerable computer time. 
The second approach is genera l ixabie to any network and is relatively 
easier to use, but it reflects loss information about the probability 
distribution of delay, 

Because of the importance of launch delay as an objective function 
and in view of the simple network example discussed earlier, either of 
these approaches will perform bettor than the more conventional ready* 
rate or FOS models. How much better remains to bo evaluated, however, 
when more complete network and component characteristics data can be 
made available, 

DATA ISSUES 

The value of any logistics planning model is largely dependent on 
the quality of data used to run it, The data presently available to 
support logistics decisions were based on a comparability study of heavy 
aircraft components. That study provided estimates of maintenance 
demand rates (fjDRs), i.e, , the rates of component removals that generate 
demand for spares. There are two fundamental problems with these MDRs. 
The first is that they implicitly assume knowledge of component 
operating time, and operating tir.e is not now routinely recorded. The 
second problem is not unique to the shuttle vehicle provisioning 


problem, or even to NAHA operations in general: initial estimate* of 

component characteristics am notoriously unreliable. Thus, the orbiter 
initial provisioning problem is complicated by a severe paucity of 
useful, reliable information, 

Discussions with NASA and its contractors have revealed no plan to 
use component removal or failure data from the first si# orbitar flights 
to revise the initial MDRs , Furthermore, no systematised collection of 
component failure or removal data or operating time has been 
implemented. We infer from this that NASA intends to make logistics 
decisions on the basis of the initial ostimatos alone. A retrospective 
study of the F-16 initial provisioning problems, which is summarised in 
tliia report, suggests that, if the initial estimates alone do constitute 
the basis for those decisions, the performance of the resulting stockage 
posture could probably be achieved at dramatically less cost (or, 
conversely, given a specified Investment level, the performance of the 
stoekage posture could be dramatically improved) if an alternative 
strategy were used that took advantage of the body of theory that has 
emerged from the initial provisioning scenario. 

The same F-16 study demonstrated that initial MDR estimates could 
be dramatically improved by revising them with sparse, initial 
operational data using Bayes-hin techniques. On the basis of these 
results it suggested the NASA revise it* current initial estimates using 
data from the early shuttle flights, and that ip establish a program to 
continue the revision process as well as collecting or estimating 
operating time. It is also suggested that the uncertainty -surrounding 
these MDR estimates be explicitly considered in the logistics planning 
process and models. The modeling approaches developed in this report 
accommodate this uncertainty. 
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*. MANAGEMENT ISSUES 

NASA dons not now have the data collection systems, the analytic 
modeling capability, or the management controls it needs for effective 
logistics management. NASA’s current data systems, for example, do not 
allow systematic recording or estimation of subsystem or component 
operating times. Vet the only available estimates of component; demand 
rates require st least estimated operating times to be useful. 
Furthermore, the data systems currently in use in the STS program are 
largely contractor-operated and lack interface. Spares requirements and 
logistics support policy recommendations are made by each major 
contractor independently, using models that may not be appropriate to 
the unique logistic support problem that the STS launch and recovery 
environment presents . 

It seems to us important that NASA and the Air Force continue to 
develop, implement, and use the kinds of decision aids discussed in this 
report within their management framework. The following paragraphs 
off or some specific recommend it, ions . 

RECOMMENDATIONS 

The models presented here demonstrate that it is feasible to 
develop improved analytical logistics modeling capabilities that will 
relate logistics support decisions and resource requirements to the 
capability to meet STS launch schedules. The evaluation and 
demonstration of the payoff to be gained from using these techniques 
remain to be done. It is recommended that these actions be accomplished 
in two phases because of the large amount of data that would be required 
for a full-scale evaluation. Recommendations concerning improved data 


collection ami parameter estimation are detailed below, Those are 
important regardless of the logistics modeling methodologies that NASA 
may ultimately choose to use. 

Improved Data Collection and Faramatar Estimation 

It is recommended that NASA: 

1, Modify or design and implement an integrated data collection 
system that would routinely provide up-to-date component 
removal data, repair times, repair level distributions, 
retrograde shipment times, order-and-ship times, condemnation 
rates, procurement and repair costs, procurement lead times, 
and operating times or usage estimates, 

2, Assemble whatever data are available (from either formal or 
informal systems) from previous STS flights and compare these 
data with those parameters currently being used for logistics 
planning and resource requirements computations. From this, 
judge whether revisions to initial estimates are required, If 
such is the case, as is likely, revise, the initial estimates 
using the Bayes -Lin technique suggested in this report or a 
similar Bayesian technique. Continue this revision process as 
more flight experience is gained. 

3, Estimate the uncertainty surrounding component removal rates 
and other logistics system performance parameters, and 
explicitly consider them in making logistics policy decisions 
(e.g., level of repair decisions) and in determining spares 
requirements . 
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Phat* h Initial Prototype Oavalopmant and Evaluation 

It Is recommended that Lhe evaluation and full-scale development 
and implementation of the logistics system capability assessment and 
spares optimization methodologies be carried out in two phases because 
of the difficulty in obtaining the necessary, detailed STS recovery task 
network and component data. The first phase would focus on the 
evaluation of these methodologies, using a limited set of representative 
components. If the outcome of the first phase is positive, the second 
phase would refine the techniques and implementation, For Phase I the 
following stops are recommended: 

1. To the extent technically feasible, extend the methodologies 
presented in Bees. II and III to include non-Poisson processes 
With finite populations; multiple stockage points, including 
Vandenberg Air Force Base and other possible stockage sites; 
and variance-to-moan ratios other than unity, 

2. Identify a subset of components that, to the extent possible, 
represent the population of all components from each of the 
projects (orbiters, boosters, tank and main engine). At the 
same time develop criteria to determine the range of components 
that should generally be considered in such models, 

3. For that select subset develop the detailed network data 
corresponding to the prelaunch schedule of operations, 
including the demand and fill nodes for each component, and 
collect the most up-to-date component data. 
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4. Determine whether the network representation for these 
components is compatible with the assumptions inherent in these, 
methodologies, If there are compatibility problems, develop 
and evaluate network editing techu*ques that could allow these 
methods to be used. 

5. Evaluate and demonstrate the use of the capability assessment 
methodology using simulation for comparisons as appropriate, 

6. Evaluate and compare the two stockage optimization techniques, 
in terms of launch delay or stockages costs, presented in this 
report (a) with each other and (b) with those techniques 
currently in use by NASA, using the capability assessment model 
,/r simulation as appropriate. 

Phase M; Prototype improvement and Implementation 

If the Phase I evaluation results are positive, the following steps 
for Phase II are recommended: 

1, Modify and improve the methodologies based on the Phase I 
results, In addition, improve them, to the extent feasible, so 
that they will be suitable for individual projects as well as 
for overall system assessment, will consider the availability 
of manufacturing assets, and will include indentured components 
CSRUs, etc,). 

2, Define and assess their potential use for integrated logistics 
management of logistics operations, level of repair analyses, 
development of out -year requirements, and procurement and 
budget decisions. 
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3. Develop and implement a full-scale system. 

The implementation oi these several stops can be. expected in the 
longer run to deliver significantly more cost- effective logistics 
support to the STS program than NASA’s current plans. 
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I. INTRODUCTION 


The National Aeronautics and Space Administration (NASA) and the 
U.S, Air Force currently face policy decisions of fundamental importance 
to the formulation of a sound, coherent, logistics support strategy for 
the Space Transportation System (STS), The importance of these 
decisions Is clear * Not only do they involve large amounts of money, 
but they will also shape the essential character, quality, and cost- 
effectiveness of STS logistics support, 

The policy decisions to be made include the determination of the 
maintenance concept for the STS, i.o., the location, depth, and scope of 
component repair, levels of maintenance, and repair responsibility; the 
modes of transportation to be used for retrograde and serviceable 
component shipments; the proportion of component repairs to be done at 
each level of maintenance; the amount of investment in tools and 
equipment, and its allocation; the amount of investment in reparable and 
consumable spare, parts; and the spares stock level, by location, of each 
of the system's components. 

Clearly, these decisions are interrelated. The computation of a 
spares posture depends on component characteristics, such as repair 
times and transportation times, that are the products of other policy 
variables, such as maintenance concept and level -of-repair decisions. 
NASA needs to understand how alternative maintenance concepts, choices 
of repair locations, repair level decisions, and transportation modes 
affect, for example, spares investment requirements and launch 
capability as a function of those investments. The complexity and 
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Interdependencies of tlm decisions suggest the need for a logistics 
system capability assessment methodology that would enable NASA to 
evaluate policy alternatives as they affect a direct and meaningful 
measure of system performance, such as expected launch delay, and to do 
so in full light of the costs of those alternatives, Implicit in such a 
capability assessment methodology is the need for explicit 
representation of the relationship between system performance and spares 
investment level. 

To assist NASA in meeting these needs, this report identifies the 
characteristics of an analytical modeling capability that will relate 
logistics support decisions and resource requirements to the capability 
to meet STS launch schedules, taking into account the unique 
characteristics of the shuttle program with its small fleet size and 
tight recovery and launch schedule. The report also presents feasible 
analytic approaches to both the capability assessment and the spares 
optimization problems. Because such an analytic capability is only as 
good as the input data, a discussion of the quality and availability of 
data within NASA is also presented. 

THE UNIQUE DIMENSIONS OF THE STS PROGRAM 

NASA's STS Program differs sharply from previous NASA programs, 
such as Apollo, STS is NASA's first program with a relatively high 
launch rate of reusable vehicles; as a result, NASA has been faced with 
developing logistics policies to support a program that is significantly 
different from those it supported previously. The analytical 
methodologies and decision aids that are readily available to support 
logistics decisions have been developed for sustained military 
operations, The STS Program departs from such operations, however, for, 
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unlike the military, It has a vary small fleet size and a tight, but 
well defined, launch schedule, both of which have an impact on the 
development of sound logistics policies. 

Typically, military aircraft are deployed in fairly large numbers 
and generate relatively large numbers of sorties. For defense purposes, 
it is clearly desirable to hold "ready" as many of these aircraft as 
possible. Because one cannot predict when it may be necessary to h /e 
these aircraft mission capable, "ready" is taken to mean "ready at a 
random point in time," 

In most spares requirements models, such as METRIC (1), VSL 
(Variable Safety Level, the Air Force's implementation of METRIC), 
MOD-METRIC [2 ] , or Dyna -METRIC {3,4], supply performance is indirectly 
related to the requirement that aircraft be ready at a random point in 
time, Brooks, Gillen, and Lu [3J show that spares stockage results for 
models that emphasize inventory system performance (e.g., minimize 
expected backorders) or total system performance (e,g., minimize the 
expected number of grounded aircraft) yield essentially the same mixes 
of spares within a weapon system under the requirement of relatively 
high levels of readiness, at random points in time, or relatively high 
budget levels. In fact, the probability of experiencing no grounded 
aircraft is the same as the probability of no backorders; this is often 
called the "ready rate" of the system, or the operational rate. The 
system ready rate is the product of several probabilities, each of which 
is called the probability of sufficiency (PCS) or ready rate of an item, 

Such a measure of system performance may be quite appropriate in 
many situations but may not be appropriate to the STS. A given shuttle 
vehicle (orbiter, solid rocket booster and external tank), for instance, 



wil’ actually be on the ground a large percentage of the time’, 
therefore* it is questionable whether STS ctockage decisions should bo 
based upon such measures of performance as system ready rate, 

Determining spares requirements by stocking an item such that its 
POS strikes at least a prescribed level* or, in some sense, by 
maximising the system ready rate (e,g., via marginal analysis (5,6]), is 
not an appropriate method for the STS. 

A typical shuttle vehicle will b« on the ground much of the time, 
and the times at which it will be required for launch will bo determined 
by the launch schedule, In particular, it is not required that a 
shuttle vehicle be "ready" at a random point in time. We believe, 
therefore, that appropriate spares stoekago postures and repair level 
decisions may be quite different from those currently emerging from the 
STS community. 

The decisions that NASA must make ate fundamentally important to 
the logistics support of the STS. Yet NASA is not now able to assess 
the effects of those policy decisions on launch capability or expected 
launch delays, Spares requirements and repair level decisions are meant 
to secure the launch schedule!, therefore, such decisions should 
explicitly recognize this purpose. Current models are not appropriate 
for assessing such decisions because of their focus on steady state 
readiness rather than, say, expected launch delay, 

This report demonstrates that the full development of an assessment 
methodology that corrects shortcomings of current models is not only 
feasible but of great importance to NASA in understanding the effects on 
launch delay of the various logistics policy decisions currently being 
made, We do not necessarily recommend that the methodology be adopted 
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by the various NASA contractors, but rather *tiat NASA itself undertaka 
full. development and use of this methodology to better understand the 
effects of spares requirements and repair level decisions upon launch 
availability and the required costs to support a specified level of 
* launch availability. 

Repair level analyses usually attempt to formulate a minimum-cost 
repair level decision for a given item or group of items. Such analyses 
are usually not connected to measures of system performance, and are 
usually only loosely connected to spares stockage methods. In the ST:, 
environment, ns discussed above, the spares stockage methods currently 
In use are not connected to measures of system performance. In this 
report, we develop spares requirements methods that are directly related 
to system performance, an obvious improvement over methods currently in 
use. Moreover, with our methods, the effocts of repair level decisions 
on system performance can be evaluated directly, as can their effects 
upon spares costs, given a specified level of system performance. 

Current methods cannot do this. 

Since the various shuttle vehicles are not required to be ready at 
a random point in time, current methods of estimating the effects of 
spares requirements, and repair level decisions upon system performance, 
or the costs required to achieve, a given level of system performance, 
are not applicable. To illustrate the point somewhat simply, consider a 
system composed of only 100 components and assume that the item POS is 
the same for each item. If each item POS is 0.95, then the system ready 
rate is (0.95) 100 » 0.0059. On the other hand, if the decisionmaker 
wishes the system ready rate to be at least 0.95, then, if all the item 
POSs are equal, each must be at loast CO . 95 ) = 0,99949, However, 
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such a PQS may be expensive to attain* moreover, it may be unnecessary, 
ror instance!, a failed item may bn repaired before the launch schedule 
is threatened, The example points out again that it is inappropriate to 
try to determine stock levels of individual items, or appropriate spares 
investment levels, without methods that explicitly relate such levels to 
system performance. 

Shuttle operations, during the operational phase, will consist of 
four or five vehicles making approximately 20 flight# per year. Thus, 
STS operation is distinctly different from that of typical military 
aircraft, As a result, logistics decision tools need to differ somewhat 
from those developed by and for the Air Force. 

Typical pralauneh operations of a given shuttle vehicle include 
inspect, transfer, assemble, test, fuel, and checkout. These activities 
take place at several locations and frequently result in the discovery 
of malfunctions, which may in turn result in demands for replacement 
parts for the orbitor, boosters, or external tank. Often such parts are 
expensive, and, because repair facilities are often remote from the 
location of demand, relatively long resupply times may occur. 

Generally, replacement parts are available from stock on hand, local 
repair, cannibalization of other vehicles, remote repair by the 
manufacturer, or depot -level repair. 

During prelaunch operations, total demands for parts for a given 
shuttle vehicle are likely to decrease as the prelaunch schedule 
approaches the launch date, since n large number of the malfunctioning 
items will have been discovered earlier in the prelaunch preparation 
process, On the other hand, the potential penalty for not having a 
spare of a demanded item or for not being able to rapidly repair tends 


to increase as the launch date approaches, However, it is not correct 
to concentrate only on the countdown phase Just before launch, or on any 
other particular phase of the prolaunch schedule, to make appropriate 
Blockage and repair level decisions. For instance, the later phases of 
prelaunch operations provide some information for stockage decisions but 
are relatively useless for appropriate remote repair level decisions, 
because time has become increasingly critical and most repairs 
undertaken at that point, to fill a part demand, are more likely to 
delay the shuttle launch. Similarly, if repair times are in fact quite 
short, the early phases of the prelaunch schedule provide little 
information for stockage decisions. Clearly, the entire prelaunch 
schedule of operations must b© considered carefully to make useful 
stockage and repair level decisions, 

The problems of selecting stockage and repair level policies and 
evaluating them, in terms of a measure of effectiveness directly related 
to launch delay, have throe distinguishing features, 

1, The vehicle in question is required to be ready not at a random 
point in time, but merely thin a given number of time units 
from the beginning of pre launch operations, 

2. Tb' prelaunch operations plan specifies the project network of 
activities to be carried out. Therefore, given the prelaunch 
operations plan, it is possible to identify the points in the 
schedule where demands for a particular part might occur, For 
instance, a demand for a certain type of valve may occur during 
checkout of the propulsion system but not during checkout of 
the guidance system, 


3. Tho effect of n part shortage on delay depends not only on the 
length of time the shortage exists but also on (1) whore in the 
prelauneh schedule of operations the demand occurs* (2) whore 
in the schedule tho demand must, be, .filled, and 13) the repair 
time of die part, which, in turn, is the result of the basic 
repair level decision for the part in question. 


AN ILLUSTRATIVE EXAMPLE 

The following simple, example is presented to clarify the issues 
discussed above. It should not, of course, be construed as representing 
a typical shuttle prelauneh operation schedule. 

Figure 1 is a project network, the start of which is at node 1 and 
the end of which is at node 7. As usual, the nodes represent events in 
time and the arcs represent activities. The orientation of each arc is 
from the lower numbered node to the higher numbered node. The numbers 
on the a. represent activity times. For instance, activity (5,6) 
requires 5 time units and activity (3,4) requires 13 time units. The 
project network also reflects mandatory precedence relations, For 
instance, activity (3,4) may not begin until activity (2,3) is 
completed, and activity (6,7) may not begin until both activities (4,6) 
and (5,6) are completed. Note that the earliest possible completion 
time of this project is given by the length of the longer of the two 
paths beginning at node 1 and ending at node 7. The longest path in a 
project network is called the critical path and its length is the 
project duration. In Fig, 1, the critical path follows the upper path 
and its total length is 44. 
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Suppose that that* are two line replaceable units, LRU^ and LRUj, 
which can fail and possibly delay the projoet. In particular, assume 
that LRUj can fail at node 2 and, if it joes fail, that it must be 
replaced before activity (5,6) can begin, We say that LRU^ has node 2 
as its demand node and node 5 as its fill node. Suppose that LRU 2 also 
has node 2 as its demand node, and that it has node 3 as its fill node, 
Finrlly, suppose that the repair time for LRU^ is 16 and the repair time 
for LRUg is 5. Figure 2 represents the situation. Note that if there 
is no spare of either LRU, then a failure of l-RUj will delay the start 
of activity (5,6) by 10 time units but will not delay the project. That 
is, the project duration is still 44 time units, However, if LRU^ 
fails, the project duration will be increased by 3 time units to a total 






Fig. 1 — An illustrative network 
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Fig. 2 - An illustrative rwtwork with two item* subject to failure 
and associated resupply times 


of 47. Under ready-rate optimization, it is clear that there are 
conditions where spares of LRU^ will be stocked, but perhaps none of 
LRU^. For instance, if the failure rate for LRU^ were larger than that 
for LRUg, and the cost of LRU^ less than the cost of LR^, then the 
stockage would be greater for LRU^ than for LR^. Moreover, aside from 
condemnation spares, the stockage of both items would spend more than is 
needed to minimize delay (i.e., additional project duration time). 

The following will illustrate the point. Let the failure rates and 
unit costs of LRU^ and LRU,, be, respectively, X^^ = 0.25, Cj = 10 and X^ 

= 0.05, = 20. Suppose that the resupply times are t^ = 16 and t^ “ 

5, and assume a budget of 40. A simple marginal analysis [5] shows that 
the amounts of each item to stock so as to maximize the ready rate, 
subject to the budget constraint, are = 4 and S 2 = 0. Thus, the 
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ready rata optimization stocks four units of the item whose failure does 
not, and none of the item whose failure does, threaten to lengthen the 
project duration. 

Additionally, if ono is interested in deciding which repair times 
should be shortened, then ready-rate or POS optimization methods, if 
used to determine the tradeoff between stockago costs and repair time 
reduction costs, will generally lead to incorrect results. For 
instance, under the assumptions above, such an analysis will conclude 
that there is greater payoff in reducing LRU^ repair time than there is 
in reducing LRU^ repair time. Of course, the project network approach 
demonstrates that the exact opposite is true, 

Generally, an LRU type may have more than one demand node. For 
instance, assume that there are two units of LRU^. One of these units 
has node 2 as its demand node and node 3 as its fill node, and the other 
unit has node 6 as its demand node and node 7 as its fill node. If 
there is one spare unit of LRU^ in stock, then, neglecting remove, and 
replace times, one or two failures of LRU^ cannot delay the project. To 
see this, note that, if the LRU 2 at node 2 does not fail, then the spare 
of LRU^ can be used to cover the possible failure of the other LRU^ at 
node 6. On the other hand, if the LRU^ at node 2 does fail, it will be 
replaced by the spare, and the failed unit will be repaired in 5 time 
units. If there is one spare unit of LRU 2 , the failed LRU 2 will be 
repaired in time to become an available spare to cover the possible 
failure of the other LRU^ component at node 6. Such is not the case if 
the repair time of LRU^ is 25 time units, for, if there is one spare 
LRU 2 , the project will be delayed by four time units owing to failures 
of LRU 2 at nodes 2 and 6, 
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The above simple example captures the flavor of the complicated 
relationships among the prelaunch schedule of operations, repair times, 
and stock levels, and their effects on project delay (i.e., launch 
delay), Moreover, since repair level analyses affect the component 
repair times of failed components, repair level decisions should fully 
recognize these complicated interactions. Herein lies some of the power 
of capability assessment, 

In the remainder of this report, we discuss the development of 
models '-hat focus on launch delay in contrast to optimization models 
that limit themselves to ready rate, Specifically, in Sec. II we 
discuss capability assessment applications, and in Sec, III the spares 
optimization problem. Section IV presents a discussion of data issues 
in initial provisioning, A summary and recommendations are provided in 
Sec. V. 
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II. CAPABILITY ASSESSMENT 

Two general approaches to developing a logistics capability 
assessment model to represent the STS environment are Monte Carlo 
simulation [7,8] and analytic queueing modeling. Each has its 
advantages and disadvantages. Simulation is, to an extent, not limited 
by the amounts of detail that can be incorporated* but it usually 
requires a large input data base and frequently becomes slow and costly 
to run, In addition, because of the random variation in any particular 
run, many computer runs are required before a valid meat, or standard 
deviation of any output measure can be obtained. Therefore, especially 
for low-failure-rate items, this approach may become unsuitable for use 
as a spare requirements methodology or for doing sensitivity analyses 
because of the many runs required for a detailed examination of just one 
of the many parts in a logistics system. Indeed, the potentially 
threatening efiects upon launch delay of low-failure-rate items are 
usually difficult to expose through standard Monte Carlo simulation 
experiments . 

Analytic queueing models are more difficult to derive, and 
compromises usually have to be made about the amount of detail they can 
incorporate. When trying to derive an analytic model, one is forced to 
seek an abstraction of the relationships among the various system 
components, This is a useful exercise on its own and is easy to 
overlook in simulation. If available, analytic models definitely have 
an advantage because of their ease of use. One single run can obtain 
means and standard deviations, and dealing with many parts is not a 
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problem, These models, then, are more suitable for capability 
assessment, spares requirements computation, and sensitivity analyses. 

There are some simulation models in use by either NASA or the Air 
Force for limited purposes (e.g, , JFK's ARTEMIS, MFSC's BOSIM and 
extensions, AFTRC's LOOM shuttle simulation); but, for the reasons 
stated above, we believe that a general analytic capability assessment 
model is needed which represents the unique characteristics of the STS 
environment. 

AN ANALYTIC MODEL FOR CAPABILITY ASSESSMENT 

The following discussion describes in non-mathematical language the 
characteristics, capabilities, and limitations of the model developed in 
subsequent pages. The model is intended to serve NASA's need for 
capability assessment. Although it is specific to a particular network 
structure, l.o., that of the AFTEC LOOM network (12,13), it can be 
extended to other, more complex networks. It is not, however, a general 
network model, Its implementation would require validation as well as 
additional data describing certain characteristics of the NASA project 
network, It is, nevertheless, a promising approach that we believe 
deserves additional research because of its potential for quantifying 
the effects of alternative policy decisions and clarifying the 
interrelationships among them in terms of both cost and launch 
capability, 

Given a network structure similar to that of the AFTEC LCOM 
network, which can be represented as two major sets of tasks essentially 
in parallel followed by a third, the model will compute the probability 
of launch delay, the probability that the delay will be less than any 
specified value, and the expected length of delay as functions of spares 
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stockage levels, repair times, and transportation times, The 
computations are network-specific. They take explicit account of task 
times and slack times in the network. Thus, the computations enable the 
model to estimate the effects of changes to the network as well as 
policy alternatives, 

In addition to requiring descriptions of tasks in the network and 
their expected durations and interdependencies, the model requires data 
that describe the points in the network where parts of each type can ba 
demanded, and the points in the network at or before which parts of each 
type are required to preclude subsequent task delays, Duta describing 
parts characteristics (demand rates, costs, repair times, etc.) are also 
required. 

The model uses a steady-state approximation to launch delay by 
focusing on the delay of a typical shuttle vehicle that has just entered 
the prelaunch schedule of operations. Cu. course, as stated above, the 
probability distribution of this delay depends critically upon important 
parameters of the logistics system such as demand rates, spares stockage 
levels, and repair times, 

Additionally, the model derived in this -eporfc is a 
non-cannibalization one. We chose to develop such an initial model for 
two main reasons: (1) there seems to be a great deal of uncertainty 

with respect to those items that are interchangeable from one shuttle 
vehicle to another, and (2) a computational model that takes explicit 
account of cannibalization will, with respect to relatively low-failure- 
rate items, recommend that cannibalization be routinely considered and 
utilized. We feel, therefore, that although cannibalization is a 
management strategy available to NASA, its incorporation into a 
computational model is inappropriate at this time. 
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The discussion that follows describes the development of the model 
in necessarily mathematical terms. The general reader is referred to 
the end of this section for a summary discussion of the analytical 
approach developed thus far, and for recommendations for further 
development and evaluation. 


DEVELOPMENT OF THE MODEL 


Consider a queueing system in which part failuros cause arrivals of 
customers and completions of part repairs cause departures. Let the 
state of the system, Z^(t), bo the number of parts of type i in the 
system at time t, o.g,, waiting for repair or in repair. { 2^ ( t ) , t S 0) 
is a stochastic process with state space {0,1,2,,,.}. 

Let the process have Poisson input with identically distributed 
exponential intorarrival times with mean l/X'^, The repair time random 
variable, Y^, has a general distribution with finite mean 1/y ^ , Also 
assume that the arrival and repair processes are independent, 

We will assume for now an infinite number of servers and an 
infinite calling population, though results can be obtained similarly 
for other cases. Let S, be the stock level for part type i, If X. 

A X 

denotes the state Z^(t) of the system at a random point in time, then by 
Palm's theorem [ 10,11), in the steady state, X^ has a Poisson 
distribution with mean X^/y^. 

We proceed by finding the distribution of waiting time (until a 
part is available) W^ given that a failure of part i was just detected, 
We then obtain the distribution of U^, the unconditional waiting time- 
Groups M j , j = 1,2,..., of part types are selected so that their part 
failures (if any) are discovered at the same rime and required later to 
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be operational at the same time. We then find the distribution of iP, 
the aggregate waiting time for the? parts in the group M^; that is, 

lP * max(lJ k , k c Mj). 

Each group of parts, Mj , has a fixed delay, Kj, in addition to the 
random waiting time, lP. In addition, we define K Q to be a constant 
representing certain characteristics of a NASA shuttle network, as 
discussed below. 

Some of the groups of random arcs are arranged in parallel with 
respect to other groups in the NASA project network, and some in series. 
After consideration of the AFTEC network for the LCOM model [12,13] and 
the STAR reports [14], we are optimistic that the actual duration of the 
NASA shuttle network can be accurately represented by the delays in any 
number of the groups of arcs in parallel, plus the delay in one group in 
series. (Refer to Fig. 3.) 

From the AFTEC and STAR nets, the {M.}» and hence the corresponding 
(U J ), correspond, in increasing order, to orbiter unscheduled 
maintenance before the orbiter integration test; to SRB unscheduled 
maintenance before and during SRB and ET stacking; and to unscheduled 
maintenance before and during the SRB/orbitor mating and shuttle 
integration test. It is clear that there is also a group of 
deterministic arcs, corresponding to scheduled maintenance tasks that 
could be represented by constants, (K^), K Q corresponds to payload 
processing; K^, '<< 2 , and Kg correspond to scheduled maintenance tasks. 

With groups M^ and M 2 * n parallel and Mg in series, the delay 
random variable, D, is given by 
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LEGEND: 

K 0 , K,, K 2 ■ Duration of tchvduM twk* b*tw*#n A and B along path ihown 
Kj * Sam* tKOapt batMwan B and C 


Fig. 3 - An abstraction of a shuttle project network 


D = max{K 0 , Kj + U 1 , K,, + U 2 ) * K* + U 3 , 

Where the constant k" = maxtKg, K^, K 2 >. Note that K* 4- X 3 is the 
duration of the project network if no failures are discovered. 

The payoff of this approach is derived from the presence of the 
{Kj}, which generate slack times for some of the (Mj). These slack 
periods allow time to get parts from repair/ resupply , not just from 
stock on hand, without delaying the project network. This also 
emphasizes the potential payoff of expedited repair and transportation 
for selected parts. 
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The elements of (Kj) are obtained from the scheduled tasks in the 
AFTEC LOOM network (slightly modified) by finding the longest path 
between two nodes in a directed network, which in the basis of the 
critical path method of project networks (cae Ch. 5 of [15], for 
example), and which enabled us to derive the graph of F*g, 3, 

DISTRIBUTION OF THE CONDITIONAL WAITING TIME 

Consider the above stochastic process in steady state. This is 
equivalent to assuming that a group of shuttle vehicles has been flying 
sorties for some period of time at the frequency expected in the 
operational period, currently estimated to be 20 or more flights per 
year, 

We want to find the cumulative distribution of the waiting time, W, 
until a part is available to satisfy a demand, given that its failure 
was just discovered. To simplify our notation, We drop the subscript i 
corresponding to part type i in this subsection. Thus wo wish to find 
Prob[ W 5 w j. The following priority rule will be assumed for the 
current model. 

Priority Rule, Parts entering the repair process lose their vehicle 

identity, and vehicles take advantage of the spares stock 

protection on a first-come, first-served basis. 

Thus, since Y denotes the repair time and S the stock level, 


Prob[ W .< w 1 Prob[ Y < w ] 


if S = 0. 
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is defined as follows: 


- Probability of at least nm* transition into state k 

• i «t* , , k in repair/ resupply) within w time units, 
given that state j was just entered duo to an 
arrival and the system is in steady state. 


Note that we have used the priority rule stated above, in that a 
vehicle will not have its demands satisfied unless all demands ahead of 
ire sat «s?ied. It follows that 


Pr< h{ V < w J ~ Prob [ X < S ] + 


£ Vi,s l “) Pi '“ b i x * * i 

x*S 


Now, the probability mass function of X is Poisson with mean 
X'j/lu, since wo are. looking at the system at a random point in time. 

On the other hand, the distribution 0^ is difficult to obtain, because 
it is affected by subsequent incoming failures, For the problem at 
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hand, however, many failure rates are rather .small, So we obtain an 
approximation, Jl^, k 1 j, by assuming no further arrivals; thus, H.^wj 
£ i.e., is eoHH«rvative. In using this approximation with 

no more arrivals, the repair rate becomes proportional to the number 
currently in repair, i.e.» p; if we were to allow additional arrivals, 
the repair rate would be greater- With this approximation, the failure 
that just arrived nan be repaired avoiding to tire distribution of Y ; 
however, items already undergoing repair have a remaining repair time 
given by the equilibrium distribution fu»* the distribution function of Y 
(see Takaos [11], p. 161) i 


A(w) * p / Prob[ Y > y )dy 


We now derive an explicit expression for it^. First, let R^ 
denote the distribution function of the jth order statistic, j « 
l,2,..,n, of the equilibrium distribution, A; n is the sample sixe. 


R ,Cw) * 2Z\ k ) A Cw)(1 " A(w)] ' 
J k«j 


for A(w) < 1, 


where l k / is the binomial coefficient. Note that 


R^j (w) » 1 for A(w) = 1. 


Furthermore, let = 1 for j - 0, It follows that 
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H Jk (w) * Ttobf Y SI w + Pr ' ,;( Y > W !R j-l j-k (w)> 

k * U,i,,.,,j-1. 

Note that, for Y exponential, the equilibrium distribution, A, is equal 
to the distribution function of Y. In this case, ” Hj In the 

case of exponential repair, (Z(t), t 2 0} becomes a special class of 
continuous -time Markov chains called the birth and death process, for 
which a substantial amount of literature exists For Y deterministic, 
A(w) is uniform, reaching unity when w reaches 1/p, 

DISTRIBUTION OF THE UNCONDITIONAL WAITING TIME 

Let (N^(t), t 2: 0} be the counting process of cumulative discovered 
failures by time t of parts of type i for the vehicle in question, and 
let t s= Q at the time of the last launch, Assume that the present 
vehicle had all of its parts operational at t = 0, It remains to be 
determined what time should be counted in t: flying time, power-on 

time, time equivalent of cycles, etc. This problem is discussed further 
in Sec. IV. 

Note that the failure rate X'^ of the Poisson input of (Z^(t), t £ 
0) is a multiole of the X^ used here, where the factor is the number of 
shuttle vehicles in operation adjusted by any other system, such as the 
Shuttle Avionics Integrated Laboratory (SAIL), that generates part 
failures , 

To obtain the distribution of the {U^}, we simply condition on 
whether a failure has been discovered by time t, where t denotes the 
time the present vehicle landed, or some time during the refurbishing 
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process In a turnaround network in preparation for the next launch. 

Thus, for u k 0, 

Probl U i £ u ] * Prob( N^Ct) * 0 ) + Probl h^ft) > 0 ) Probl Wj « u ), 

and equals zero otherwise. In giving an overview of the model, wo 
defined 


U J « mnx{U^, k t . K h } 


It follows that 


Probl ^ S u ) a Prob[ u k - u )< 

k:;Mj 


It is clear that this approach can be further generalized to allow 
each part type k to have a constant component V^, since in such case, 


n 

keM. 


Prob[ < u ] = 1 J Prob[ U,^ £ it - ), for u S mnx(V^, k ’ M^} 


and equals zero otherwise. 

THE DISTRIBUTION OF DELAY 

We discussed above how some STAR and AFTEC networks led us to a 
representation of the shuttle network with a delay given by 


1) = mox(K 0 , K 1 + U 1 , K,, + C 2 } - K'' + U 3 
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wn< the constant K ~ K^, K^}. In the last section, wo h how oil 

how to obtain tin* distributions of the The presence of groups of 

arcs in parallel is no problem; however, having the resulting 
distribution of this parallel system connected ip series with another 
group of arcs may cause technical problems unless the parts of the 
latter group .are different from those in the, parallel groups. If such 
is the case, then the resulting distribution is determined by the 
e«nv*»lut ion 


i t ub( I) ^ e 



U 12 5 K* f + e - y ]d tProbl U 3 £ y )), 


ert 


Prob[ U 12 < k" + u ] » I»roM I ;1 S K 

f or ti > 0. 


K. + u ] ProbI U 2 £ K - K 0 + 

X tm 


If there are parts in common among the groups of arcs in series, 
then convolutions are not appropriate, since the independence assumption 
would no longer hold. However, with or without independence, the. 
expected value of the delay, E [ D J , can always be obtained as tK sum of 
the expected values of the components in series, i.e., 

E[D] « E[U 12 ] + E[l’ 3 ] 


As a practical matter, the independence assumption can oe ignored and 
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the convolution approach ‘-an still lm used. , n.:- ■; . ... ■ 

required to evaluate the validity of this nppvovimut *“U *>tb i d'.nmn 
of applicability, 

PERFORMANCE MEASURES DERIVED FROM THE DELAY RANDOM VARIANT 

Once the probability ctisti ibnl ion >4 is »*> found, vuriuu 
performance measures can easily be ti»>x ived: i u example, the 

launch delay, the variance or standard deviation of 1 inn- h iteiay, the 
probability of no launch delay, the expected launch delay time given 
that there is a delay, and the probability that launch delay is less or 
greater than any specified value. An interesting extension is possible 
if there exists some delay time, say l) (jl such that, if the lausrh oi 
some shuttle of interest is delayed lunger than i)^, the launch of the 
next shuttle will also be delayed; then the probability distribution of 
D also yields the probability that D will exceed D y , that is, the 
probability that the next shuttle will also be delayed. 

Note, too, that if a penalty function, P(d) dollars, due to a 
shuttle launch delay of d days, can be specified, the expected penalty 
per shuttle launch due to delays can also be computed directly from the 
probability distribution of I). 

ADAPTING THE MODEL TO DEAL WITH DATA VARIABILITY 

In the case of simple Poisson input, the number of parts in the 
repair pipeline, , has a Poisson distribution; therefore, the variunco- 
to-mean ratio for X. equals unity, in cases where the the quality oi 
the data is in question, it may be appropriate to model this lack of 
confidence by using a probability distribution whose va r i ance - t o-itear 
ratio is greater than unity. In fact, attempts have been made to 
estimate this ratio using Bayesian methods [1], 
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A suitable model to incorporate this ratio parameter is to assume a 
compound Poisson process input with a logarithmic compounding 
distribution (see Feller [16), Sherbrooke [17]), In this case, the 
number of parts in the repair pipeline has a negative binomial 
distribution. Wo will show below that results obtained above easily 
generalize to accommodate this approach. 

Also, when using Bayesian methods to incorporate recent history in 
the estimates of revised failure rates, it is a common approach to 
assume a gamma "prior" distribution. This approach is discussed in Sec. 
IV. Again the resulting distribution is negative binomial, 

In preparation for future use of either of the above approaches, we 
generalize the above results for compound Poisson input. We emphasize 
that the modeling of this type of input is merely a device that can 
serve either the variance-to-mean ratio representation or the Bayesian 
approach, In particular, we do not assume that in the shuttle 
environment parts failures occur in batches, To be sure, further study 
and comparisons are needed in this area to evaluate the impact of either 
approach . 

We now generalize the above results. For simplicity, we again drop 
the subscript i, the part type. 

A stc'hastic process, (X(t), t k 0), is said to be a compound 
Poisson process if it can be represented, for t > 0, by 

N(t) 

k=l 

where (N(t), t 2 0} is a simple Poisson process with mean 
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m(t) * E[ N(t) ] * U'p/U - p)) t, 0 < p « 1, 


and (I , n « 1,2,,,,} is a family of independent random variables having 
a common distribution called the compounding distribution, The Poisson 
process and the compounding distribution are assumed to be independent, 
{N(t), t i 0) is the cumulative number of customers that arrived by time 
t, whereas I denotes the demands that the nth customer brings. By a 
conditioning argument, it follows that X(t) has the compound Poisson 
distribution 

» r- n -1 

Prob[ X(t) = x ] = Prob( N(t) = n ] Prob 1^ = x , 

n*Q >k*=0 


where 



x 


is obtained by the n-fold convolution of the distribution of 1^, 
If the compounding distribution is logarithmic, that is, 


Prob[ I n = y ] = (1 - p) y /(y log p” 1 ) 0 < p < 1, 


then the distribution of X(t) can be shown to be negative binomial [16] 
with parameter m(t) and density function 


* 

**» 




< 


u 
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Prob[ X(t) * x ] 


ra(t)+x-tj p mCt) Cl - p)*, 


where m(t) « Ef N(t) ] * (X'p/(1 * p))t, The mean 
E[ X(t) j * m(t) (3, - p)/p * X't, 

and the variance 

Var[ X(t) ] * m(t)d - p)/p 2 . 


Therefore, the variance-to-mean ratio equals 1/p , 

Feeney and Sherbrooke [18] proved that, with compound Poisson input 
and arbitrary repair distribution, the number in the steady state 
pipeline has a compound Poisson distribution, provided that all the 
demands that a customer brings complete repair at the same time: 


00 

Prob[ X = x ] = J"* Prob[ X' = n ] Prob 
n*0 




where X' , the number of customers in the pipeline, has a simple Poisson 
distribution with mean (X'p/(1 - p))/y, and (1^} correspond to the 
compounding distribution. X is the total number of parts still in 

t 

repair. 

As before, if the {I n ) have a logarithmic compounding distribution, 
the resulting distribution of the number in the pipeline under steady 


( 
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state is negative binomial, but this time with parameter (X‘p/(1 - p))/p 
instead of m(t). 

The results for the delay random variable generalize for the 
compound Poisson process. If we assume the exponential distribution, 
for w 2: 0, 


Prob[ W * w ) * Prob( Y £ w ) if S * 0. 


For S > 0, wo condition on the actual number of customers, X', in the 
pipeline, before an arrival that just occurred, This yields 

Of* 

Prob| V < w ] = V Prob[ W 3 W | X' “ X ] Probf X* * X } . 
x=0 

Consider defined as follows: 


H x (w) = Probability that, within w time units, the number of 

total parts (the sum of all batches) in repast does not 
exceed S, the stock level, given that there are x 
parts already in repair, and one more customer 
just arrived. Also, no more arrivals are 
assumed to occur, 


Clearly, 


Prob[ W < w | X' = x ] £ H^Cw) , 


It follows that 
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x+l/x+l\ r x+L-j *1 

H x (w) - TJu / A J Cw) (1 - A(w)) X+1 “ J P«ob Vl^S 

jTo v 7 L 3 

A comparable expression can be obtained for the case of a general 
repair distribution. 

ADAPTING THE MODEL TO DEAL WITH FINITE SERVERS 
AND A FINITE SOURCE POPULATION 

A major difference between the STS environment and that of the Air 
Force is the number of sorties and flying hours involved in the flying 
program. Obviously, this number is relatively small for the STS case. 
The difference is relevant in that, for the Air Force case, one can be 
more easily convinced that using the infinite calling population 
assumption is appropriate. But it may be necessary, in making the 
infinite population assumption, to restrict the domain of validity of 
the model for the STS environment to a smaller class of components that 
share certain characteristics, 

A second assumption made in most logistics models is that of slack 
repair capacity, or, in more precise terms, of an infinite number of 
repair servers. We believe that for the STS, this assumption may be of 
no major consequence because of the low expected maintenance demand 
rates, unless repair times are excessively long. Both of these issues 
are addressed in the following paragraphs, 

First, recall that thu results shown previously were derived for 
failures arriving according to a simple Poisson process, whereas the 
repair was assumed to have a general distribution with an infinite 
number of servers. Also, an infinite population source was Implicitly 


assumed. We now take the initial steps necessary to generalise the 
above results by discarding some of these restrictions. 

We assume the exponential repair distribution to obtain a birth and 
death process for which many results are available [15,19], In 
particular, we will look at the number of parts in the queueing system. 

The probability distribution for the number in the queueing system 
under steady state is known for any number of servers (see Ifillier and 
Lieberman [15]* pp> 397-399), For example, the distribution is 
geometric for the single server case: 


Probf X* « x ] * Cl - p’p 


where p 1 ^ 

For the single server and finite source population, the 
distribution of the number in the system is also found in Hillier: 


and 



MI/CM - n)! (p 



» 


Prob [ * k ] * Ml/ CM - k) f (p i ) k Probf X. = 0 ), 

k = 1, . . . ,M, 


where M is the size of the source population (in some cases, M will be 
the number of shuttle vehicles) and p^ is the ratio X^/u v , 

For the case of infinite servers and a finite source population, 
the distribution can be derived from the steady state birth and death 
equations (see [15], p. 394). In tills case, we have 


- 32 - 


gric#’AL ewe ** 

OF POOR QUALH’Y 


Prob[ • o J « 1/(1 + Pj r l , 
and 

Prob{ Xj. « k ] * M I / ( k J ( M - k}<) (p t ) k Prob[ X. « () j, 

k » 1, , . . ,M. 

This finite source model can also bo incorporated into an 
analytical network approach, but additional development and evaluation 
are required. 

SUMMARY 

Part of the research problem called for the identification of 
requirements for an analytical modeling capability that would relate 
logistics support decisions and resource requirements to the capability 
to meet launch schedules. Several different approaches were assessed 
and the most promising has been presented in this section. We have not 
only shown the. theoretical feasibility of the approach, but have also 
performed the initial steps of the computational model development. In 
this summary, we review what has been accomplished and what remains to 
be done, 

One of the model requirements is that it incorporate the project 
network structure information, including slack times. The network must 
include all the major shuttle components: orbiter, solid rocket 

boosters, and external rank. The example in Sec, I shows that the 
network can, at times, have ari overriding impact on the spare parts 
quantity and mix required to meet a particular launch goal, The 
modeling approach developed in the present section assumes certain 
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network characteristics and is not generaliaable to all networks. It is 
applicable only to networks of the type shown in Fig. 3, which is 
similar to the AFTEC LOOK network. That network, however, does not 
provide sufficient detail about the demand and fill nodes for individual 
components, and this approach remains to be evaluated using a more 
detailed network. 

Another part of tho research problem requires that the model 
provide a probabilistic launch delay measure along with resulting 
statistics, since such a measure deals specifically with the ability to 
launch on time. These measures are needed to estimate the potential 
costs of shuttle launch delays caused by an imbalanced logistics support 
policy. 

An important characteristic of the STS program, in contrast to Air 
Force logistics situations, is its small fleet size and flying program. 
The model presented here has the potential to incorporate the small 
fleet size. In this section we nave laid the groundwork for dealing 
With this problem. The preliminary results presented here can be used 
to estimate, the sensitivity and impact of small fleet size on the 
proposed shuttle operations, and can be incorporated in our capability 
assessment approach as necessary. 

Section IV, below, points out some problems with data which we 
assume will be corrected over time. Meanwhile, the uncertainty in the 
currently available data should be considered explicitly in the model. 
The approach presented here can incorporate any variance-to-mean ratio 
as a distribution parameter. 

We believe that we have developed a potentially powerful assessment 
approach. We trust that after completion of the additional development 




and evaluation tasks described above, the resulting model tan be used 
for STS logistiCB policy studies. 

This section derives the approximate probability distribution of 
the time one must wait for a given part. The section also demonstrates 
how data uncertainty as well as finite repair capacity and finite source 
population can be incorporated so as to derive a more appropriate 
probability distribution of the time one must wait for a given part. 

We recommend that NASA undertake a computational development of 
this distribution. Such a development, together with a representative 
network corresponding to the prelaunch schedule of operations, would 
provide an excellent estimate of the delay of a typical shuttle vehicle 
as a function of spares Blockage levels, repair and transportation 
times, failure rates, and the underlying network. 

Of course, we recognise that not all items need necessarily be 
considered and that a separate study should be made to discover those 
items that should be included in such models, 
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III. SPARES STOCKAGE OPTIMIZATION 

The problem dincussed in this section has two elements. The first 
is to find a method for estimating the relationship between spares 
investment level and a direct, meaningful measure of system performance, 
such an expected launch delay. An explicit representation of that 
relationship would allow NASA to determine the spares investment level 
required to support any specified level of system performance, or, 
conversely, to specify the desired level of performance in full light of 
Its costs. 

The second element of tK problem is to ensure that, for each level 
of performance, the required spares investment level is minimal. Each 
of those components of the problem implies the other. What is needed, 
then, is not only an explicit representation of the relationship between 
performance and cost, but one in which each point i« optimum in the 
sense that it represents the least-cost mix of spares for the specific 
level of performance, and, conversely, represents the best possible 
performance for the specific level of investment, 

The computation of such a relationship depends on estimates of 
component c haractoristics that emergo from definition of the system's 
maintenance concept and repair level decisions, and the quality of the 
estimated relationship depends on the quality of the estimates of 
component characteristics. Issues related to the quality of available 
component-level data are discussed in Sec. IV, where we recommend 
several important steps for NASA to take to Improve those data. 
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Here we address the problem of computing the optimal earns 
8 lockage posture for any specified level of spares investment. Vo 
develop approaches to two forms of this problem for the specific network 
structure discussed in Sec. II--one in which We minimize expected delay 
subject to a budget constraint, and one in which we maximize the 
probability that delay does not exceed a specified length of time, given 
a budget constraint. Item resupply times are inputs to these 
computations; therefore, repair level decisions can be evaluated in 
terms of spares investment requirements and system performance. 

It is important to realize that the computation of a stockage 
posture is optimal for some specified set of component characteristic' 
However, those characteristics are largely determined by selection of 
transportation mode; location, depth, and scope of repair; tool and 
equipment investment levels; test equipment software capability; and 
other characteristics of the logistics system. Therefore, each computed 
estimate of the performance/cost relationship must be viewed as 
pertinent only to one set of assumptions about the system, its 
dimensions, and its operating characteristics. The models developed 
here are useful and powerful, but only when applied to the problem in 
the perspective of the entire logistics system. For example, one might 
compute the least-cost ntockage posture required to deliver some 
specified level of expected launch delay based on a set of reasonable 
assumptions about repair times, Then one could vary the repair times to 
reflect alternative levels of repair, repair locations, or 
transportation modes, and observe explicitly how the cost of the 
stockage posture changed to achieve the same level of performance as 
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bejUue. Alsu, it une could estimate reasonably tin* costs of tho 
j! torn U ives sn repair and transport at ion, a "lodst-cost" solution could 
bo approximated to tin* combination of inte.rdepeude.nt decision problems. 
This gives some sense of tho integrated view of the problem that is 
needed to employ these models most constructively. 

In the remainder of this section, we develop the spares 
optimization models. Again, because the discussion is necessarily 
mathematical, we encourage tho general reader to continue reading at the 
start of ,Sec. IV. 

SPARES OPTIMIZATION WITH THE AFTEC LOOM NETWORK 

As described in See, 11, the delay random variable of a NASA 
project network (.an be. written as 

IKS) = max{K 0 , L* 1 CS 1 ) + k^, U 2 tS 2 ) + k' 2 ) + t' 3 (S 3 ) - K* 

12 3 i 

whe.re, the stock vector is S = (S , S , S ) and S J is the vector of stock 

corresponding to components in M., j = 3,2,3. We are assuming that M 

J a 

has no items in common with Mj or M 9 . We have made the dependence on 
stock, S, explicit, because that is the variable to be optimized. In 
Sec. II we found that 

xj Prob[U 2 (S 2 ) < K - K + e - x] 


Prob[ DCS) <; e ) 
e 


/ 


ProbfL^CS 1 ) £ K” - K : + e - 


d(Prob[U 3 (S 3 ) < x]), 



«n»* 
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where K = max{Kg, Kj, K,,}. 


Two Measures of Effectiveness 

We will examine two measures of effectiveness, ME! and ME2, 

ME1: One approach is to allocate stock according to the expected 

delay given by 


no 


E[D(S)j = 


f 


Prob[D(S) > y]dy. 


Given a budget level B > 0 for stock, an appropriate optimal stockage 
allocation can be determined by solving the stockage optimization 
problem 


min E (D(S) ] , 
S 


subject to 

T* C. S. SB, 

J J 

3 

s. i o, S, = 0,1,2...; j = 1,2,.... 

That is, S is within the budget B, is the unit procurement cost of stock 
of type j . 

ME2: Another standard approach is to choose some time e auu 


allocate stock so as to maximize the probability that project delay does 
not exceed e. The stockage optimization problem is then 




« 


< 
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max l 3 rob[ D(S) $ e ), 
S 

subject to S, which is within the budget B. 


Solution Mathods for ME1 and ME2 

Both stockagc optimization problems, ME1 and ME2, have nonseparable 
objective functions and are not amenable to standard solution methods. 

However, we have developed approaches to these problems that are 
computationally feasible for problems with a large number of items to be 
stocked . 

In the first place we state a result to be found in [20]. 

Fact: Let b(y;S) be a positive function for each y and each 
stockage vector S. If two stockage vectors S' and S M can be found so 
that i 

t 

b(y;S')log b(y;S M )dy > 

f 

then I 



/ 


b(y ;S' ) log b(y;S')dy, 


y*b(y;S")dy > J b(y;S')dy 


We now show how this fact can be used to develop solution methods 
for ME1 and ME2. 




Solution of ME1: Since 


/* 




% , 
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E{D(S)] «* E[max{K 0 , U^S 1 ) + U 2 (S 2 ) + &,).] + E[U 3 (S 3 )) - K*. 


wo may write 


E [D(S) j 


f Cl - Prob[U 1 (S 1 ) S K* - K x + y) Prob[U 2 (S 2 ) S K*- K’ 2 + y])dy 


+ f (1 - Prob[U 3 (S 3 ) < yj )dy - K\ 
0 


and, therefore, for o suitably large L we ha\'e 


E(D(S)) = 


L 

L - j ? robfU^S 1 ) <; K* - Kj+ y] ProbfUjCSj) < K*- K 2 + y])dy 


0 


L 

/ 


, 3 ,„ 3 , 


+ L - J Probfl) (S ) < y])dy - K , 
0 


Therefore, the optimal stockage allocation for problem ME1 may be found 
by Solving the problem 
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ME1 : 


max 

S 


' / (Q Prob(Uj(Sj) £ K*- K t + y) J~| ProbfUj (S^) S K*- K 2 + y]^ 


/( n 

~ \)eM- 


Probes.) £ y] I dy, 


subject to 


E °j s j + E c .i s j s *■ 

jfMjUMj, j£M 3 

Sj 5; 0, integer-valued. 

Problem ME1 is a nonseparable problem in the integer stock 
variables; hence, standard solution methods, such as dynamic programming 
and marginal allocation, do not directly apply, However, the Fact 
described above is directly applicable. 

For ease of explanation, let the budget B > 0 be divided into two 

12 12 
parts, B >0 and B > 0, so that B = B + B 


We now define a subproblem, FM1, of the original problem. 
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FM1 ; 


i 

/ 


max / b(y;5)dy, 
S 


1 o 1 

subject to S , whore S” is within the budget B , and 


b(y;Sj «= 

|”|prob(iySj) 5 K*"'- Ky yj J""|prob|iy SjJ < k”- h' 2 + y] , 

jeM 1 JeM 2 


and, for FMi, it is understood that the stock vector S includes only 
those items j such that J c.M.l'M,, . 

4 A- 

We now use the results from [20], stated above, in solving this 
subproblem. 

Stockage Algorithm: Select any stock vector S 1 that satisfies the 

budget constraint. Solve 


FMI(S’) : 


max 

S 



b(y;S’ j log 


bty ;S jdy 


10 1 

subject to S , S* - within the budget B . Let S" be optimal, The hope is 
that this subproblem is easier to solve. From the Fact above, if 
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j b(y;S')log bty{S")dy > J bly;S')log b(yiS')dy, 

0 0 


L L 

j b(y;d"jdy -• J blysS'jdy. 


That is, S" is hot Lei than S' for the problem FMl, the one wo are 
interested in. Sot S' E S" and resolve FMl(S'). 

It remains only to determine whether Fill (S') can easily bo solved, 
Hy the definition of this problem, we may rewrite FMl(S') as 

FMl (S’) : 


max 

S 


£ u j ,s j iS ' 5 

jEM l UM 2 


i '< t 

subject to K ,S“ within the budget B , where 


L 

u . ( S j ; S 1 ) = j b(y ;S ' ) log ProbfiyS.) < K*- K+ yjdy 
0 


and K equals or K,,, depending on j being in l^or M 0 , Therefore, the 
objective function for FMl (.S') is a separable function in the. stockage 
decision variables S,, j e , and standard methods, such as dynamic 

programming, or perhaps marginal allocation, can be used to solve 
FMl (S' ). 
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Hie point is that the*, difficult atockagc problem FM1 can be 
approached by solving a sequence of easier problems of the form I'M ICS 1 ), 
This same idea can then be applied to the second part of MEl, written as 


SMI: 



ProbfUj (Sj) S y)dy, 


3 2 

where S is within the budget B . Therefore, optimal solutions for MEl 

can be found relatively easily. Of course, it is not at all obvious how 

1 2 

a given budget, B, should be optimally partitioned into B and B , That 

is, to determine how much of the budget should be allocated to stock in 

Mj and M2, and how much should be allocated to stock in M^, one must 

begin by essentially solving the overall problem. This situation is not 

uncommon, however, and various "resource directive" strategies can be 

employed to yield insights into a nearly optimal decomposition of the 

budget into B* f and B 2 \ In particular, an approximate Lagrange 

multiplier for FMl, with respect to B*. can be found that represents the 

gradient or rate of change of the optimal value of FMl with respect *0 

changes in B*. Similarly, an approximate Lagrange multiplier for SMI, 

with respect to B , can also be found. One then compares these two 

1 2 

multipliers to determine the direction of change for B and B . Since 

1 2 

B + B = B must hold, one budget will be increased and the other 

decreased. We are hopeful that this procedure will quickly provide an 

optimal, or nearly optimal, decomposition of the budget B into and 
B 2 *. 


»*?** 

< 
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Solution of ME2 

Problem ME2 is also not separable in the stoekage decision 
variables, However, the method discussed above for expected delay 
minimization is applicable. 

Briefly, lot S' be a stoekage vector that satisfies the budget 
constraint, Define 

b(xiS’) w 

Prob[U 1 (S' 1 ) £ K*- K + e - x] Prob[U 2 (S ,2 l £ K*« Kg + e - x] 
. d{Prob[U 3 (S' 3 ) £ x]}, 


3 

where d{ } is the probability density function of U . We then solve 

FM2(S'): 

max 
S 

0 

where S is within the budget B, to find an improved stoekage allocation 
as in the solution procedure for ME1, The objective function for 
problem FM2(S') can then be rewritten as 


l 

/ 


b(x;S')log b(x;S)dx, 




i 


ORIGINAL PAGE IS 
OF POOR QUALITY 

- 46 “ 


E 

f b(x;S' 

)log 

Proh[Uj CSj) S 

A 

k - Kj+ 

r»i 

J 

0 




r, 

£ 




+ E 

1 bCx'.S 1 

' )log 

ProbfUjCSj) £ 

* 

K - k2+ 

j.« 2 

0 

t 




+ 

h 

f b(xiS' 

'H°S 

d{Prob[U 3 (S 3 ) 

S x])dx. 


The first and second sums are separable in the stookage variables 
Sj , j e MjlIMg. Therefore, standard procedures such as dynamic 
programming or marginal allocation may be employed with respect to thes 
variables. However, 


d{Prob[L , 3 (S 3 ) £ x] > = r^(x;Sj)| |prob[U.(Sj) 5 x] , 

■i-»3 -1’»3 


where 


r^ Cx;Sj) = diProbfUjCSjl^xD/ProbtU, (S.)^x] . 
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This implies that 


j b(x}S' ) log d(Prob[U 3 (S 3 ) S x]}dx 
* V / b{x jS 1 ) log Prob[U. ($ .) S xjdx 
+ ^bfxsS'jlog ^tj(x;Sj)dx . 


The first term after the equals sign is separable in the stockage 
decision variables Sj, j e M^, but the second one is not. However, we 
arcs confident that approximations can be made so that the ideas or 
strategies presented for problem ME] will remain valid for ME2. 


AN APPROACH TO MORE GENERAL NETWORKS 

If the project network corresponding to the prelaunch schedule of 
operations cannot be well represented by a project network of the type 
presented in Sec. II, then the probability distribution of project 
network delay cannot easily be written In terms of the individual 
probability distributions of delay corresponding to individual line 
replaceable units. Moreover, even when the probability distribution of 
delay can be written for more general networks, the stockage 
optimization problems, in terms of this distribution, are likely to 
prove intractable. We therefore present the following stockage 
optimization procedure, in terms of arbitrary project networks, to 
demonstrate that certain optimization methods can overcome the above- 
mentioned difficulties. 
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For instance, Fig, 4 represents a project network, whore each X^ is 
a random variable representing delay of the corresponding arc. There 
are three paths, the length of each being a random variable. The length 
of the first path is 


P, » X, + X 


4 1 


that of the second path is 


P 2 * X 2 + Xj j 

and that of the third path is 


P 3 * X 2 + X 3 + V 



Fig. 4 - A network with correlated path lengths 


c*K4r\i 
gf r *»• 

* * w - 

Tin* time random variable for project duration Is then 

T * max {Pj, P 2 , Py) 

* max (Xj + X 4 , X 2 ♦ X», X 2 + X 3 + X’ 4 >. 

Hero, and P^ are correlated and P 0 and P^ are alto correlated. 
Therefore, the probability distribution of T in not the product of the 
probability distributions of each path length. 

The example above demonstrates the need for alternative stockage 
optimization procedures, given the results of repair level analyses, 
when the project network corresponding to the prolaunch schedule of 
operations is of a more general nature than that described in Sec. II* 
The standard deviation of delay of an Individual LRU is relatively 
large compared with Its mean. The cumulative probability distribution 
of do,lay of an individual LRU Is typified in Fig, 5. Specifically, the 
height at the. origin represents the probability of no delay, and the 
cumulative probability distribution then climbs rather slowly toward 
unity. Thus, even though the probability of no delay can be relatively 
large, the expected delay can also be relatively large. Note that the 
probability distribution depends up«n the stock level of the item as 
well as upon failure rate and repair time. 

Even though wo may not be able to easily compute the probaLi 1 ity 
distribution of delay for the project network corresponding to the 
prelaunch schedule of operations, Fig. 5 represents the general nature 
of this distribution. 


i» * 



- 50 - 


ORIGINAL PAGE 19 
OF POOR QUALITY 



Therefore, a stockage model capable of determining good stockage 
allocations in all project network situations is needed. To motivate 
such a model, we consider the delay caused by a single LRU^, denoting 
this delay random variable by U^(S^), where is the spares stock level 
of LRUj,. Let EfU^CS^) ] denote mean delay and let o(S 1 ) denote the 
standard deviation of the delay caused by LRth, By Chebyshev's 
inequality [ 21 ], we have 

Prob[U i (S i ) £ E[U i (S i )] + ko i (S i )] < 1/k 2 . 
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That is, the probability that delay, as a function of spares level, will 
exceed mean delay plus a multiple, k > 0, of the standard deviation is 
less than l/k~. For instance, if k “ 3, then the above probability is 
less than 1/9, Moreover, it is known that the probability is usually 
lower than that suggested by Chebyshev’s inequality. 

The above discussion suggests that with each LRU^ we associate a 
delay function, a function of the stock level, denoted by 

W = E f u i (s i>] + ko i CS 1 ). 

This function will serve as an approximation for the delay associated 
with LRLh, and D^(S^) can be computed by using the distribution of 
U^(S^) developed in Sec, II. 

Given a spares vector, S, that satisfies the budget constraint 

£ C i S l * B ’ 

.1 J 

we wish to find a spares stockage allocation S* that is optimal in the 
sense that it minimizes an approximate project network delay, where the 
delay due to LRU^ is given by the function 

D.CS.) = E[U i CS i ) ] + ko.CS^, 

and the approximate project network delay is the length of the critical 
path resulting from (D^(S^)J. 



*> 
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Lot Lj(S)» LgfS), .... L^fS) be the lengths, given a spares 
stock.age allocation, of the N paths of the project network corresponding 
to the prelatmch schedule of operations. Then, 

y s) -v Sw- 

ltP j 

where Pj denotes those arcs of path j that correspond to LRU delays, and 
k. is the sum of the times of the remaining arcs of path j . Figure 6 
clarifies the notation, Here, = 16 and two arcs on this path 

correspond to LRUs. The length of path j , as a function of and S,., 
is 


V S) ■ 16 + D n <s n> + W- 



Fig. 6 — Typical path in a project network 
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Tin* spares stockage optimization problem is 


ME3: 


min mas: h./S), .... I^.CS)), 


subject to S within the budget B. 

Even though the project network may contain a very large number of 
paths, N, problem ME 3 can be relatively easily solved. Assume that we. 
have found u •' \ piths of tlie project network. We then solve the 
op t i m i k a t i on proble m 

ME3(n): 

min y 

y Up £ W' J * 

ii-P 

i 

subject to S within the budget, B, where S 0, integer-valued, for all 
r, and We let y*, S* be an optimal solution. Then S* is an optimal 
allocation for MK3, and y* is the project duration, if, and only if, 


* kj + J2 D i (S 'V’ j = !. •••- N. 


iGP 


Of course, we know the above inequality to be true for all the paths of 
MKBtn); however, we do not know whether this inequality holds for all 
the paths not contained in ME3tn), However, by solving a single longest- 
path problem for the project network with arc lengths corresponding to 
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LRUs given by 1)^(8^). we may determine whether these inequalities hold, 
Let j* index such a longest path, If 

r- * kj„ + £ W 

,,P 3 

then S* is an optimal allocation for ME3. If this constraint is not 
satisfied, we replace j* by n + 1 and S*^ by S^, and introduce the 
resulting inequality as the constraint, corresponding to path n + 1, 
into problem ME3(n) to form a new problem with one more path constraint, 
ME3(n + 1) , 

The above process must terminate in a finite number of steps with 
an optimal spares allocation for problem ME3. Moreover, the delay 
function D^CSp is such that each ME3(n) problem can be solved 
relatively efficiently. A preliminary computer program has been 
developed at Rand for this purpose. The potential value of this 
approach lies not only in computing spares requirements for general 
networks, but also in providing additional computational capability for 
networks of the AFTEC LOOM type. 

SUMMARY 

We have demonstrated the feasibility of developing stockage 
optimization techniques in terms of measures of system performance 
(e.g., launch delay) that incorporate the project network corresponding 
to the prelaunch schedule of operations. The problems are 
mathematically tractable and we are confident that the techniques 
developed above will also apply to the model versions that will 
incorporate aspects of a finite source population and limited repair 
capacity. 
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The spares optimisation methods of Sec, III, mid their 
corresponding computer programs, need to be fully developed to handle 
the large number of different items typical of the Space Transportation 
System, Moreover, these methods must he modified so that (1) shop 
replaceable units can be explicitly taken into account, (2) the finite 
source population and limited repair capacity can be incorporated, and 
(3) the inherent uncertainty in the input data is not ignored. 

Additionally, the underlying "NASA NET," the most appropriate 
project network of the prelaunch schedule of operations, needs to be 
developed. Modifications of our basic methods can then be fully tested 
and evaluated in that context, which is the one most suitable for 
assessing spares requirements and repair level decisions. For instance, 
there may be environments in which the results of current spares and 
repair level decisions are quite adequate in terms of our measures of 
system performance. But we cannot identify those environments until the 
above-mentioned developments have been carried out. We therefore 
recommend that they be undertaken. 
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IV, DATA ISSUES IN SPARES PROVISIONING 

The data available to support provisioning decisions for the 
orbiter were based on failure rates observed on components of heavy 
aircraft [22, p. 148}, Among the available data are estimates of 
maintenance demand rates (MDRs), i.o,, rates of component removals thaL 
generate demands for spares. There are two fundamental problems with 
these MDRs , The first is that they implicitly assume knowledge of 
component operating time, and operating time is not now routinely 
recorded; therefore, the MDRs are not appropriate for use in spares 
requirements computations without at least estimates of operating time. 
The second problem is not unique to the orbiter provisioning problem, or 
even to NASA operations in general: initial estimates of component 

characteristics are notoriously unreliable. Thus, the orbiter initial 
provisioning problem is complicated by a severe paucity of useful, 
reliable information, In addition, because the maintenance concept has 
not achieved final form nor all of the level-of-repair decisions been 
reached, initial estimates of other component characteristics, such as 
repair and transportation times, uhich depend on the level-of-repair 
decision and maintenance concept, cannot be viewed as reliable either. 

Another very 'nportant characteristic of any collection of initial 
MDRs is that, in the aggregate, they should be consistent with 
reasonable estimates of the mean time between failure (MTBF) rates of 
the orbiter as a whole. In other words, the inverse of the sum of the 
initial MDRs of all the LRUs on the vehicle ought to be consistent with 
the expected MTBF of the vehicle. If this is not the case., there may be 
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bias in the MDRs that could lead to a decision on initial spares 
investment that would be inconsistent with the desired level of system 
performance; i.e., serious over- or underinvestment could result. 

Discussions with NASA have revealed that there is no plan to use 
component removal or failure data from the first six flights to revise 
the initial NDRs, Furthermore, no systematized collection of component 
failure or removal data or operating time has been implemented, We 
infer from this that NASA intends to make decisions on both investment 
level and spares mix on the basis of the initial estimates alone. Our 
experience with initial provisioning problems suggests that, if the 
initial estimates alone constitute the basis for those decisions, the 
performance of the resulting stockage posture could probably be achieved 
at dramatically less cost Cor, conversely, given a specified investment 
level, the performance of the stockage posture could be dramatically 
improved) if an alternative strategy were used that took advantage of 
the body of theory that lias emerged from the initial provisioning 
scenario. 

NASA could take several steps that would substantially improve the 
cost-effectiveness of its initial provisioning strategy. In the 
remainder of this section, we discuss these steps and offer observations 
and analyses directly applicable to the orbiter provisioning problem. 

THE F-16 CASE 

The. discussion that follows draws heavily on a recent study [23] 
that examined the initial provisioning of the U.S. Air Force's F-16 
aircraft program, initial provisioning was applied to the first two 
years of scheduled production, 150 aircraft. The scope of the study was 
limited to 810 recoverable (reparable) line replaceable units (LRUs) and 
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shop replaceable unite (SRUs) unique to the F-16 aircraft. Common 
spores and consumables were excluded. The study specifically addressed 
the issue of the usefulness of early operational data in revising 
initial estimates of component maintenance factors (component removals 
per 100 flying hours). The distinction between maintenance factors and 
HDRs is that MDRs estimate or measure component removals per 1000 hours 
of operating time. In the F-16 program, maintenance factors were used 
because of their consistency with Air Force data systems. The study 
examined the accuracy of initial estimates of maintenance factors and 
unit prices, It concluded that unit price estimates were quite 
accurate, at least for the sample chosen, but that initial estimates of 
component maintenance factors were heavily, systematically, and 
positively biased. The accuracy of ord er initial estimates of component 
characteristics, such as not-reparable-this-station (NRTS) rates and 
repair times, was not examined. 

Initial Estimates 

In the F-16 program, the prime contractor, General Dynamics, 
recommended that a mean flying time between failure (MFTBF) rate of 2.9 
be included in the weapon system's specifications, Data collected 
during the first two and a half years of the weapon system's life on the 
810 recoverable DRUs and SRUs peculiar to the F-16 yielded an MFTBF of 
5.82. In addition to the 830 peculiar recoverables , the F-16 consists 
of approximately 1200 common recoverables and many consumables as well, 
An allocation of roughly half the total number of failures on the 
aircraft to the 810 peculiar recoverables seems reasonable to us, since 
they tend to be the most complex and most prone to failure, Therefore, 
the MFTBF of 2.9 recommended by General Dynamics seems consistent with 
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the observed NFTBF on the 810 items of 5.82, However, calculation of 

* 

the MFTBF using the initial estimates of the 810 items yields a result 

of 1.45, If, in addition, common rocoverables and consumables were * 

accounted for, the calculated MFTBF would be well below 1.0. 

This simple arithmetic applied to the initial estimates of 
maintenance factors would have suggested, as early ns two years before 
the operational deployment of the first aircraft, that they were very 
heavily, positively biased. Such bias results in underestimating the 
performance expected from alternative spares investment levels, It can 
significantly diminish the cost-effectiveness of a program's initial 
stockflgo posture. 

The lesson here, for NASA in provisioning spares for STS is clear: 

Develop a set of initial MDRs that- are well founded in engineering 
judgment, tempered with data from other programs, and consistent in the 
aggregate with the. vohicle.'s system-level reliability characteristics. 

ji 

Such a sot of initial estimates would be of great utility, not only in 

determining an appropriate Investment level for ..titial spares, but also 

in computing the most effective mix of spares for that investment level. ; - 

As we will discuss, such estimates, when modified by early operational 

data, however sparse, are powerful aids in computing spares stoekage 

postures that are robust in the face of the uncertainties that pervade 

initial provisioning decisions. The estimates should be developed 

without using data from early missions because techniques are available 

for modifying the estimates with the observed data in a way more nearly j 

optimal than using human judgment alone. Furthermore, MDRs should be i 

redefined as component removals per flight hour or mission, or NASA 

should implement systematic collection of operating times. In any £ 
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event, the use of the MDK in requirements computations must bo borne in 
mind, It should not be viewed, for example, as an estimate or measure 
of "true" failures, but rather as an estimate or measure of component 
removals that induce the need for spares. 


Explicating Uncertainty in Initial Estimates 


Initial estimates of component characteristics are matters of 
substantial uncertainty, A well-known, well -developed body of theory 
known os Bayesian learning suggests that it is constructive to 
characterize one's uncertainty about such estimates by modeling them as 
random variables using probability distributions that best characterize 
the uncertainty. Probability distributions used in this way are called 
a priori distributions, or simply priors, The selection of priorr, tor 
the shuttle vehicle provisioning problem will depend on the specific 
form of the spares requirements model used and the objective function 
incorporated in it. It is the prior probability distribution that is 
revised by the observed data, the shape and breadth of the prior 
actually specifying how much weight is given to the initial estimate and 


how much to the observe c ions h > ^The theory of Bayesian learning is 
discussed in [18] . Its application^tqinventory systoms is well known; 
some applications are discussed in [25 -27] .Additional explanation and 
applications may be found in [28], 


Revision of Initial Estimates 

Based on data from the F-16 program, a method was developed for 
revising initial estimates of maintenance factors with early operational 
data that dramatically improved their accuracy, thereby improving the 
accuracy of computed relationship between aircraft availability and 


the cost and mix of spares, It also dramatically improved the cost- 
effectiveness of the computed mix of spares for any specified investment 
level. The technique applied Bayesian learning, coupled with a linear 
correction factor derived from the operational data, to the problem of 
deciding how to modify the initial estimates with the observed data. 

This method is called the Bayes-Lin technique. The fact that early 
observations are useful in revising initial estimates was demonstrated 
dearly and powerfully. 

Although development of the Bayes-Lin technique was based on n 
fighter aircraft acquisition program of very different dimensions from 
those of the STS, its fundamental logic applies to virtually any initial 
spares provisioning problem. In its implementation, however, It might 
look quite different from the technique in its application to the F-16. 
For example, the maintenance factors for the shuttle might be adjusted 
to reflect ground operating time, since that represents a much larger 
proportion of total operating time than in Lhe aircraft case, As 
discussed earlier, the expected availability of the shuttle is a measure 
of secondary interest; the primary focus should be on the expected 
launch delay due to parts shortages, Thus, while the best method of 
formulating the mathematics for the. shuttle problem may differ in detail 
from the F-16 case, its fundamental, underlying logic is essentially the. 
same. Appropriate models exist that can be used in the shuttle 
application and that are logically consistent with the spares 
requirements methodology selected. 

Interviews suggest that NASA and contractor personnel place little 
or no value on component removal data generated in the, first six space 
flights. What we know about the power of the Bayes-Lin technique 
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suggests strongly that Ignoring those early data would be a serious 
mistake. The view that there are too few data to be useful is clearly 
refuted by the F-16 analysis, It may bo helpful here to relate a story 
told by Professor Howard llaiffa in [29, pp. 20, 2’. 


Professor Ward Edwards, a psychologist at the. University of 
Michigan, has investigated the intuitive reactions of many 
subjects to experimental, probabilistic evidence. In one of 
his experiments he poses the following problem, 

"I hive two canvas book bags filled with poker chips, The 
first bag contains 70 green chips and 30 white chips, and I 
shall refer to this as the predominantly green bag, The 
second bag contains 70 white chips and 30 green chips, and I 
shall re I p/ to this as the predominantly white bag. The chips 
are all identical except for color. I now mix up the two bags 
so that you don't know which is which, and put one of them 
aside, I shall be concerned with your judgments about whether 
the remaining bag is prodomin-.iS-lly green or not. Now suppose 
you choose 12 chips at random with replacement: from this 
remaining bag and it turns out that you draw eight green chips 
and four white chips, in some particular order. What do you 
think the odds are that the bag you have sampled from is 
predominantly green?" 

At a cocktail party a few years ago I asked a group of 
lawyers, who were discussing the interpretation of 
probabilistic evidence, what they would answer as subjects in 
Edwards' experiment, First of all, they wanted to know 
whether there was any malice aforethought in the actions of 
the experimenter, I assured them of the neutrality of the* 
experimenter, and told them that it would be appropriate to 
assign a ,5 chance to "predominantly green" before any 
sampling took place. 

"in this case," one lawyer exclaimed after thinking awhile, "I 
would bet the unknown bag is predominantly white." 

"No, you don't understand," one of his colleagues retorted, 
"you have drawn eight greens and four whites from this bag. 

Not the other way around." 

"Yes, I understand, but in my experience at the bar, life is 
just plain perverse, and I would still bet on predominantly 
white! But I really am not a betting man." 

The other lawyers all agreed that this was not a very rational 
thing to do - that the evidence was in favor of the bag's 
being predominantly green. 


( 



"But by how much?" I persisted. After a while a consensus 
emerged: The evidence is meager*, the odds might go up from 
50-50 to 55-45*, but ",,.as lawyers -we 4 ^ 4^41 iited to be 
skeptical, so we would slant our bes ^judgments downward and 
act as if the odds were still roughly 50*50," 

The answer to the question "By how much?" can be computed in a 
straightforward fashion and there is no controversy about 
the answer. The probability that the bag is predominantly 
green, given a sample of eight green and four white chips, is 
,964, Yes, ,964, This bag is predominantly green "beyond a 
reasonable doubt," This story points out the fact that most 
subjects vastly underestimate the power of a small sample, 

The lawyers described above had an extreme reaction, but even 
my statistics students clustered their guesses around ,70, 


The logic of this story is especially pertinent to the initial 
provisioning problem and the reluctance of many logisticians to use 
early observations in revising initial estimates of component 
characteristics, Nevertheless, as the graphs in Fig. 7 show, such data 
may be dramatically more useful than intuition might suggest. We show 
several curves drawn from the F-16 experience that explicate the 
relationship between aircraft availability and initial spares investment 
level. One of the solid curves is computed from initial estimates 
alone, arioth< r from the initial estimates revised with one month of 
operational data representing only 49,2 flying hours of experience, and 
the other from the initial estimates revised with six months of 
operational data representing 963,5 flying hours. The dashed curves are 
computed based on two years of operational data collected after the 
initial six months of operation that generated the data used to revise 
the estimates . The dashed curves approximate what would have happened 
for various investment levels based on the stockage postures computed 
With the estimates of maintenance factors used with the respective solid 
curves. The very large difference between "computed" and "actual" where 
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only the initial estimates were used io due to the powerful, systematic, 
positive oias in the, initial estimates of the maintenance factors. Note 
the dramatic improvement in the availability-vs , -cost curve in the case 
where only one month of operational experience is used to revise the 
estimates, and the remarkable improvement in predictive accuracy - 

There are important lessons for the STS program in this analysis. 
Given a reasonable se.t of initial estimates of component removal rates, 
one should base, the initial spares investment level decision and the 
computed mix of spares on revisions to those estimates that incorporate 
all available operational (component removal) data and the essential 
logic of the Bayes-Lin revision technique. This approach can be 
expected to provide substantial improvement over current NASA plans both 
in the predictive accuracy of the spares requirements model and in the 
performance of the. resulting stoekage posture, 

SUMMARY AND RECOMMENDATIONS 

NASA needs to implement a data collection system that will 
routinely provide observed values of component characteristics, 
logistics system performance, and appropriate operating times. Without 
such data the ability to revise initial estimates of these value,s is 
seriously impaired, 

The quality of the initial MDR estimates on shuttle components is 
questionable. As a first step, they should at least be compared, in the 
aggregate, with expectations about shuttle MTBF to obtain some sense of 
their bias, 

A second step would be to estimate other component characteristics 
that affect the expected number of each type of component in resupply, 
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e,g,, repair time, ord?r-and-ship time, repair level distribution, 
condemnation rate, and procurement loadtime. Reliable unit price 
estimates are also needed. One problem is that many of these estimates 
cannot be made until the maintenance concept and levels of repair are 
determined. Therefore, these decisions should be made, as soon as 
practicable, 

A third step Would be to revise the estimates of component removal 
rates using all available component removal data, however sparse, from 
the first several shuttle missions. The Bayes-Lin technique should be 
used. (An alternative to this step would involve adaptation of the 
revision technique to a network-analytic spares requirements model. 

Such an adaptation might involve different probability models from those 
used in the F-16 case, but the underlying logic of Bayesian revision and 
linear correction should still be used.) 

A fourth step would be to determine the appropriate level of 
investment in initial spares using an explicit model of the relationship 
between performance and cost. This would enable the investment decision 
to be made in full light of the performance it will yield, and the 
converse . 

Finally, just before any subsequent computation of spares 
requirements, component removal rates should be revised with all 
available data. 
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V. SUMMARY AND RECOMMENDATIONS 

Several important observations and conclusions emerge from this 
work. NASA needs to develop a well-formulated logistics support 
strategy; however, it does not have the tools to evaluate alternatives 
in a way that takes explicit account of the interdependencies of the 
various components of such a strategy. The maintenance concept, levels 
of repair, spares investment levels, spares stockage postures, and their 
interrelationships have a significant impact on the ef fectiveposs and 
cost of the long-term logistics support of the Space Transportation 
System. 

THE NEED FOR CAPABILITY ASSESSMENT 

NASA's decisionmaking about logistics support planning depends in 
large part on analyses done by contractors using, at best, questionable 
data. These important policy decisions need to be made with full 
recognition of their impact on system performance and on the costs of 
achieving specified levels of system performance. This implies the need 
for reasonable estimates of a range of alternative maintenance concepts, 
repair levels, modes of transportation, and spares investment levels, 
and the capability to compute the least-cost spares stockage posture for 
any specified level of investment. 

The methods described in Sec. II, when fully developed, would 
enable the estimation of direct and meaningful measures of launch 
capability as a function of component and logistics support system 
characteristics. Those characteristics depend, in turn, on the 
specification of maintenance concept, repair levels, and other policy 
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decisions. Thus, we have provided an approach that can potentially 
support an integrated v ,r of the several fundamentally important policy 
de.cisions that NASA fi. ana we believe that these methods could be 
helpful in developing a cost-effective logistics support strategy. 

The capability assessment model presented hero goes far in 
demonstrating the. feasibility of an analytic approach appropriate for 
the STS environment. Initial steps have also been taken to do.al with 
the small STS fleet size and the uncertainty in the data estimates-. 
Networks similar to the AFTEC LOOM ne,t and further evaluation with a 
more detailed network that represents the demand and fill nodes are 
required . 

THE SPARES STOCKAGE OPTIMIZATION PROBLEM 

All that we have learned about logistics support strategies from 
other programs suggests that NASA needs to formulate a strategy for the 
STS that may differ significantly from that in its current plans. It 
seems clear that NASA cannot simply use a spares requirements 
computational model from, say, a military aircraft program and apply it 
to the STS. The distinctly different dimensions of the STS program, 
i.e., a small number of vehicles and relatively long periods of ground 
time between missions, prohibit this. Spares requirements models that 
have been more or less successfully applied to initial provisioning in 
military aircraft programs depend on certain steady-state assumptions 
and are oriented toward maximizing aircraft availability, maximizing 
fill rate, or minimizing expected backorders, at a randomly chosen point 
in time, given some budget constraint. Such models do not take 
advantage of the special structure of the STS program, in which a 
particular vehicle can be grounded for long periods between missions. 


The approaches to stockage optimization described in Sec, III take 
advantage of the capability assessment methods and project network 
structure of Sec. II, We believe that our approaches can provide a 
reasonable basis for developing a sound, coherent, integrated spares 
acquisition and logistics support strategy for the STS, 

Spares optimization methods, and the corresponding computer 
programs, must bn fully developed to handle the largo number of 
different items typical of those in the STS. These methods must be 
modified so that (1) SRUs can be explicitly taken into account, (?.) the 
finite source population and limited repair capacity can be 
incorporated, and (3) the inherent uncertainty in the input data is not 
ignored, 

As with the capability assessment approach, the most appropriate 
project network of the prelaunch schedule of operations needs to be 
developed, so that the modifications can be fully tested, evaluated, and 
compared in the context of the project network most suitable for spares 
requirements and repair level decisions evaluation. Although each of 
the approaches presented will do better than the typical "ready-rate” 
models, how much better will not be clear until such an evaluation is 
undertaken. 

DATA ISSUES 

The several steps discussed in Sec, IV are vital to NASA if it is 
to make its spares investment decisions with a thorough understanding of 
their implications for system performance. The ability to compute the 
least-cost mix of spares and perform credible logistics system 
capability assessments depends on those same steps. Initial estimates 


- 70 


alone do not constitute n sound basis for determining a cost-effective 
STS logistics support strategy, Data from the first few STS missions 
would be of dramatically greater worth, especially when used with the 
Bayes-Lin method (described in Sec, IV) to revise the initial estimates. 
It is important that the uncertainty surrounding estimates of 
maintenance demand rates and other logistics system performance measures 
be reflected in logistics policy development and resource requirements 
determination. Failure to achieve this would be to overestimate the 
ability of the logistics system to support the shuttle schedule, 

MANAGEMENT ISSUES 

NASA does not now have the data collection systems, the analytic 
modeling capability, or the management controls it needs for effective 
logistics management, NASA's current data systems, for example, do not 
allow systematic recording or estimation of subsystem or component 
operating times. Yet the only available estimates of component demand 
rates require at least estimated operating times to be useful, 
Furthermore, the data systems currently in use in the STS program are 
largely contractor-operated and lack interface, Spares requirements and 
logistic support policy recommendations are made by each major 
contractor independently, using models that may not be appropriate to 
the unique logistics support problem that the STS launch and recovery 
environment presents. 

It seems to us important that NASA and the Air Force continue to 
develop, implement, and use the kinds of decision aids discussed in this 
report within their management framework. The following paragraphs 
offer some specific recommendations . 
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RECOMMENDATIONS 

Tho models presented here demonstrate that it ts feasible to 
develop improved analytical logistics modeling capabilities that will 
relate logistics support decisions and resource requirements to the 
capability to meet STS launch schedules. Evaluation and demonstration 
of the payoff to be gained from using those techniques remain to be 
done. It is recommended that these actions be accomplished in two 
phases because of the large amount of data that would be required for a 
full-scale evaluation. Recommendations concerning improved data 
collection and parameter estimation are detailed below. These are 
importan ; regardless of the logistics modeling methodologies that NASA 
may ultimately choose to use. 

Improved Data Collection and Parameter Estimation 

It is recommended that NASA: 


1, Modify or design and implement an integrated data collection 
system that would routinely provide up-to-date component 
removal data, repair times, repair level distributions, 
retrograde shipment times, order-and-ship -imes, condemnation 
rates, procurement and repair costs, procurement lead times, 
and operating times or usage estimates . 

2, Assemble whatever data are available (from either formal or 
informal systems) from previous STS flights and compare these 
data with those parameters currently being used for logistics 
planning and resource requirements computations. From ,his, 
judge whether revisions to initial estimates are required. If 
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such is the case, as is likely, revise tho initial estimates 
using the Bayes-Lin technique suggested in this report, or a 
similar Bayesian technique, Continue this revision process as 
more flight experience is gained, 

3, Estimate the uncertainty surrounding component removal rates 
and other logistics system performance parameters, and 
explicitly consider them in making logistics policy decisions 
(e,g., level of repair decisions) and in determining spares 
requirements. 

Phase I: Initial Prototype Development and Evaluation 

It is recommended that the evaluation and full-scale development 
and implementation of the logistics system capability assessment and 
spores optimization methodologies be carried out in two phases because 
of the difficulty in obtaining the necessary, detailed STS recovery task 
network and component data. The first phase would focus on the 
evaluation of these methodologies, using a limited set of representative 
components, If the outcome of the first phase is positive, the second 
phase would refine the techniques and implementation. For Phase I the 
following steps are recommended: 

1, To the extent technically feasible, extend the methodologies 
presented in Secs. II and III to include non-Poisson processes 
with finite populations; multiple stockage points, including 
Vandenberg Air Force Base and other possible stockage sites; 
and variance-to-mean ratios other than unity. 

2. Identify a subset of components that, to the extent possible, 
represent the population of all components from each of the 
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projects (arbiters, boosters, tank and main engine), At the 
same time, develop criteria to determine the range of 
components that should generally be considered in such models, 

3. For that select subset, develop the detailed network data 
corresponding to the prelaunch schedule of operations, 
including the demand and fill nodes for each component-, and 
collect the most up-to-date component data, 

4, Determine whether the network representation for these 
components is compatible with the assumptions inherent in these 
methodologies, If there are compatibility problems, develop 
and evaluate network editing techniques that could allow these 
methods to be used, 

5, Evaluate and demonstrate the use of the capability assessment 
methodology, using simulation for comparisons as appropriate, 

6. Evaluate and compare the two stockage optimization techniques, 
in terms of launch delay or stockage costs, presented in this 
report (a) with each other and (b) with those techniques 
currently in use by NASA, using the capability assessment model 
or simulation as appropriate. 

Phase II: Prototype Improvement and Implementation 

If the Phase I evaluation results are positive, the following steps 
for Phase II are recommended: 


1, Modify and improve the methodologies based on the Phase I 

results. In addition, improve them, to the extent feasible, so 
that they will be suitable for individual projects as well as 
for overall system assessment, will consider the availability 
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of manufacturing assets, and will Include indentured components 
{SKUs, etc.). 

2 , Define and assess their potential use for integrated logistics 
management of logistics operations, level of repair analyses, 
development of out year requirements, and procurement and 
budget decisions. 

3. Devalop and implement a full-scale system. 

Implementation of these several steps can be oxpeeted in the longer 
run to deliver significantly more cost-effective logistics support to 
the STS program than NASA's current plans, 
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